£D 1S6 738 



DOCUttEHX fiESOHE 

■ / 



CE 025 394 



&UTUOB 
TITLE 

mSTITOTION 



SPONS &6£NC; 

POB DATE . 

GRANT 

.HOTE 

AVAILABLE FfiOM 



EDBS PBICE 
^DESCEIPTORS 



lOENTIFIEES 



. Botterbuschr Karl F. 

A Comparison of Seven VocatiDaal . Evaluation- 
Systess, 

Bisconsia Univ. - Stsut, Meaoa^ojiie. Dept. of 
Rehabilicatioii a&d Manpower Services. Materials 
Oevelopseat Center. 

Eehabilitatioa Services Administration (DHEW) , 
uashingtonr i>-C. 
Feb 76 

DHEH-SS:A-12-P-55307/5, 

49p.; For a related docuoent see CE 025 395. 
ttaterials Development Center, Stout Vocational 
Rehabilitation Institute, University of 
Wisconsin — Stout, Menoaonie, «I 54751 ($2,50) 
Menomonie, HI 54751 $1.50) 

!1F01/PC02 Plus Psstage. 

♦Evaluation Criteria;' Evaluation Methods: 
♦Occupational Tests; Psychological Testing;. 
Standardized Tests; Testing; Test Reviews; *Test 
Selection; Vocational 'Aptitude; Work Sample Tests 
♦Vocational Evaluation 



ABSTRACT 

Seven eoamerciaiiy available work evaluation systems 
are compared using a standardized outline: development, organization, 
work evaluation process, administration, scoring and norms# 
observation of clients, jreporting utility, training in the system, 
technicad considerations, reviewer'-s summary and comments, address, 
cost, and references. There are four sections: (1) a brief paper 
listing factors to be considered in selecting a commercial evaluation 
battery for such tools as on-the-job evaluations, sheltered 
employment, work samples, and psychological tests for assessing 
clients* potential; C2) an explanation of the fourteen t&ajor points 
(criteria) in tne -outline; (3) a taole presenting brief comparison of 
the seven systems on the first ten points (points 11-14 not 
appropriat2 to summarized; and (4) more detailed description of each 
system including revieieer's comments, address, cost, and references. 
The seven systems covered are Sccarron-Dial work Evaluation Systso, 
Phil^.delpbia Jewish Employment and Vocational Service (JEVS), Singer 
Vocational Evaluation system. Talent Assessment Programs (TAP) , The 
Tower S/stem, Valpar Component Work Sample Series, and wide Fangs 
Employment Sample lest (WREST). Four more recently developed systems 
are compared in a separate document (see Note). (JT) 



* Reproduc^tioas supplied by EDES are the best that can be made * 
*" "irom tb'e 'orig^ document. " > ' ♦ 
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INTRDDUCTIDN 



In December, 1971, Dr. Dennis Dunn publiehed a "Comparison of the 
'JEWS, Singer/Graf lex and TOWER Uork Evaluation Systems," This article, 
reprlntKi by the Materials DeveloiDment Center as Reprint Series No. 5, 
haa bfeer^lteaemlnated to thqusands of individuals since its Ini- 
t.ial-4JuhllcStion. Since 1971, new cammerciel ^jork evaluation systems 
have been revised and expanded, 'making the original comparison by 
Or. Dunn out of date. This publication la a revision and an expansion 
of Dr. Dunn's original uorkr it compares seven commercially available 
work evaluation systems (i.e. JEUS, McCarron-Oial, Singer, TAP, TOWER, 
V/ALPAR and WREST) using a standardized outline based on the Dunn pub- 
lication and the MDC sound/slide Orientation to "Work Sample Batteriea 
Series. 

The purpose of this publication is to present a reasonably oblectivi 
comparison of the seven systems. In preparing this comparison, manuals, 
technical reports and related publications were used to obtain informa- 
tion about each system. It Is hoped that this publication will be used 
as a guide for potential purchasers so that they can examine each syatem 
In light of' their own. needs. Facilities considering the purchase of any 
system should not only talk with vocational evaluators in facilities who 
are using a syatem, but should also see the system in afc^on prior to 
making a final decision. 

This publication contains four sections. The first Is a brief 
paper on hCjw, to select a commercial vocational evaluation syatem. The 
second is an explanation of the 1^ tnajor. points contained in the outline 
The third section Is a table which presents a very brief comparison of 
the s^ven systems on the first ten. points in the outline (Points 11 
through I'V are not presented because of redundancy or not. being appro- 
priate to summarize). The fourth section contains a more detailed de- 
scription of each vocational evaluation system, including reviewer's 
comments, address, cost and references. 

Two final comments are necessary. First, most of these systems an 
constantly being revised, expanded and updated. Second, for those who 
desire additional Information, the Materials Development Center has a 
sound-slide presentation on each of the seven vocational svaluation 
systems described in this publication. 



Karl F, Botterbusch, Ph.D. 
February, 1976 
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Some Considerations for Selection of a ClommB^Gla^ 
Vocational Evaluation System 



Oyer the years many people have '"contacted the MDC for advlc^ con- 
cerning the moslJ appropriate vocational evaluation system to purchase 
for their facility. This section was prepared in response to these 
•ret^JBsts and uill outline some o*^ the factors to be considered prior- to 
nurchaaing a commercial vocational evaluation system. The evaluator 
H^is at hi^ disposal many tools for aaseesing client potential*.: 

1. On-the-job Evaluations - These are situations in which the 
client is assessed in one or more of a variety of real usqtV 
situations including: job site situations in industry, pro- 
duction work situation. in sheltered employment, trial training 
evaluation in a tra>ining program and simulated job stations 
within- the facility. 

• 2. Work Samples - There are four types of work samp'les according 
to j their degree of correspondence with actual jobs: actual 

job samples ♦ simulated Job samples, duster trait samples and 

single trait samples. 

3. Psychological Tests - These include an almost endless variety 
or.paper-and-pencil and apparatus techniques for measuring 
traits, abilities, etc. « 

Faced with the need to equip and administer a vocational evaluation unit, 
many untrained and inexperienced evaluators feel that the purchase of a 
commerxsial evaluation battery will solve their problems. The evaluator - 
shou'Td analyze a number of factors in deciding the equippilng^- of the 
evaluation unit and then carefully investigate all the tools listed above 
to determins- the ones that will provide him with the best methods to . 
adequately assess hisi.client^. 

The first area of consideration is the relationship between the 
community and the , vocational evaluation unit.-' The evaluator , must case- 
fully investigate -the range and type of jobs that are'available in the 
local labor market. (Thus, a small rural facility or a facility in a 
one irfdustry area will most likely have a narrower range of job eval- 
uation stations than a facility in an urban area.) Labor market 
informatirfjn can be obtained through vocational' surveys , locrfl employ- 
ment offices and agencies, and client placement records- Qnce potential 
employment opportunities have been determined, intelligent decisions can 
be made on what type of evaluation tools can best assess these demands. 



*A detailed discussion of these techniques is found in: Task Force 
Wo. 2, The tools of viacatiocial evaluation, Vocational Evaluation and 
Ulork Adjustment Bulletin . 'l975, Vol. 8, Part I, special edition, 
(The three publications of the VEWAA Research Project have been reprinted 
in one volume (Reprint iMo. 12) by MDC. Price $2. DO.) 
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Because the evaluation outcomes may- not result in immeiliate place- 
ment, It Is also necessary to investigate the training opportunities 
available for clients and these should also be ref lectedi in the selec- 
tion of evaluation tools. A cl'ient'a range of occupations widens and 
his chances for upward mobility are frequently increased as a result of 
training*. The presence of art area vocational-technical scho^oi, private 
I trade and busineas schools, .on-the-job training programs, apprenticeship 
firograma and even higher education should be reflected in the evaluation 
unit. Vocational evaluation techniques covering a wide variety of 
occupational areas, and assessing the fCill range of client aptitudes and 
•interests are needed if the facility is in an area where many employment 
and training opportunities are available. 

The-^econd considere^-.ion 5b the client population. Some evaluation 
units must be capable of serving clieri-s with all types of mental, 
physical, psychological, and cultural disabilities. Other facilities 
restrict themselves to serving either a- single disability or a small * • 
number of disabilities. A facility dealing with many types of handicaps 
would generally need to have techniques covering the entire range of 
occupational 'ateas agd skill levels within these ^areas. *A facility \ 
providing services to a single disability, group could safely limit their 
evaluation areas. For example, a f^acility serving only mentally retarded 
clients could realistically avoid evaluation for occupations that re- 
quire a great deal of formalized training or higher education. Some . 
systems claim to have been designed specifically for a partiotilar level . 
of client functioning. When selecting evaluation tools, remember the 
type of clients you serve — it would be a waste of time to assess a client 
for a Job he could not fill because of his handicap. Also, at present 
oil commercial vocational evaluation systems are designed for persons 
t-who can see and heqr and contain no special instructions or moriificationB 
Vor the blind or deaf. The evaluator should be aware that he frequently 
will ha\/fe to make modifications in the work samples so that they meet 
the special needs of his clients. In summary, if you are considering a • 
commercial evaluat'.on battery, check the battery agaiF;ist the needs of 
your client- population and theVi decide: (1) if the system is designed 
for your .disability groupCs), or (2) if other evaluation techniques 
would be more appropriate. 

The third area is the purpose of evaluation. 'Although all vocational 
avaluation techniques, should provide career infefrmaticn, a particular 
technique may either emphasize occupational information by providing a . 
hands-on experience or it may emphasize the assessment of present skills 
and aptitudes without delating it tc? career information.. Some systems 
attempt to provide a thorough- evaluation of the client's aptitudes and 
work "behaviors; others provide occupational information and experience,, 
often at the 'expense bf ^ thorough ability assessment. The evaluator 
shDul-d check the final repop-t format to determine exactly^ what infor- 
mation it contains; this goes alongway in determining the purpose bf 
a particular system. The evaluator must first decide the needs in these 
areas and then attempt to find or qievelop the evaluation tools that best 
fit the. client's needs. A system should never be purchased to "fit in 
somewhere." 
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The fourth area of concern is perhaps the most basic — why even 
purchase a cQRwnercial evaluation syatem at all? All of the systems are 
relatively expensive; same are very expensive. None will probably meet 
the individual needs of a facility in terms of community jobs and train- 
ing, ^client popi/latiDna, and purpose of evaluation- A facility could 
develop Its own evaluation unit baaed on jtjb or uiork samples taken from 
local induatrv* This would make evaluation very realistic for the 
client, staff and even for a potential emplnyLr. Additional work samples 
could be developed from exiating subcontracts in the workshop. This 
method not only will assess the areas in which the client has his maxi- 
mum functiona dnd 'interests, but also the areas of the shop that would 
best fit the' client. In addition,. theJrlient would 'receive training on 
the work performed in th,e Utorkahop. Then, when thfe client is transff erred 
from the evaluation gnit, he or she will be familiar with the subcontract, 
which should alleviate the need .for the supervisor to train the client 
^rom •*scratch." 

* » t » * 

The development tsf a work aample is expensive in terms of staff 
time; In most facilities staff is hired to provide direct client service, 
*and to have a s.taff person doing developmental work reduces the time 
~avMIabTe for worlti^ clients"^ f ecrevaluation unite can afford the 

luxury of developmental, time for staff persons*. » Besides the time ele- 
ment » development of evaluation toola demands a working knowledge of 
skills in the ,ar'eas of job and task analysis, form and report deaign, 
.behavior analysis, statistics for norms, industrial engineering tech- 
niques, etc. Although these skills are becoming more and more widespread 
among evaluators, there are still many facilities that lack persons with 
these competencies. The lack 'of developmental time coupled with the in- 
experience of some evaluators is partly responsUble for t;he increased use 
of commercial evaluation systems. The purchase of these systems as a 
matter of convenience does not necesaarily it. ply that the systems are not 
useful to the evaluator. 

The first decision is whether the evaluation unit is meeting client 
nee^js in terms of accurate assessment for available Joba and/or training. 
If needs are not being met, the second decision becomes a question of. 
what areas of job assessment are needed for the evaluation unit. Af tefr ' 
these needa are known, a thorough review of the different evaluation 
tschniquea, commercial vocational evaluation batteries Cor parts of these 
batteries) and other' available resources is maie to determine how to best 
meet these, needs. There is a common practice for many persons to want 
. to buy a ayaten that will give all the answers. This simply does not 
exist* There is also the possibility of carefully selecting individual 
work aamplea from aeveral systems and combinii^g these ^ into a unified 
system specific to the needs of the facility. To. have appropriate eval- 
uation stations, there haa to be a great .deal of analysis of what is to 
be accomplished during evaluation, the available jobs and training, the 
types of clients with whom you are working and the best way to accomplish 



^1 *The MDC Uork Sample Manual Cleariiighouae is attempting to reduce 
the^ developmental time by making completed work sample manuals available 
to evali^ators. 
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the goals of your facility. This analysis is absolutery necessary 
before you can develop any system. 

The preceding points can only be used as general guidelines be- 
cause each facility is unique. A critical factor in purchasing a 
system should be based on the knouledge of what is needed and not on 
the cost or attractiveness of the hardware. Usually no one system will 
meet all the needs of a facility and. the purchased system should be 
integrated with facility constructed devices, other evaluation systems^ 
on-the-ijob evaluation, and psychological tests. MDC suggests that a/ 
facility obtain as much accurate information as possible about a system 
prior to purchase. , Some sources of information are: 

1. The inform^ion contained in this publication, ^ 

2. MDC has a sound-slide presentation on each eyarluation system 
described in thia publication. View the presentatiprfs on the system(s) . 
you are considering. y 

3. Talk with evaluators in other faciKties who are using the 
system you* have in mind and see what they/think of it. 

hm If possible, try dut the 8\fs^ni yourself with clients in another 
facility. . y/ 

5. Write 'the system's maffufacturer and obtain current information. 

In conclusion, MDC cannot^ecommend what syst^smCs) will be best for your 
facility because selectlrtg the appropriate ayatem is (or should be) 
based on an accurate, yi^alistic aaseaament of the unique needs of each 
facility* • / 

t 

Karl F. Botterbusich , Ph.D. 
Arnold B. Say, Ed.O. 




VDCATIOWAL EVALUATION SYSYeM OUTLINE 



Development 

r 

a. Sponsor - The name of the organization uiho originally funded or^ 
financed the development of the* vocation^al evaluation 'system. 

b. Target «Group - Uihaf specific populations, such as disadvan- 
taged, mentally retarded, or 'physically handicapped, yas the 
system designed to serve? ~ - , . 

c. Basis of the System - What theoretical or. organizational princi- 
ple, such as the Dictionary of Dccuoational Titles , yss used as 
a basis for development? * . ^ ' 

Oroanizatlon 

a. Name and Number uf Work Samples - What are the names of the work 
samples and houi many work samples does the system contain? 

b. Grouping of titork Samples - What is the arrangement of the indi- 
vidual work samples within the system? Are several uiork samples 
grouped in a hierarchy or is each work sample independent? 

c. Packaging of Work Samples - What is the physical set-up of the 
uork samples in the battery? 

d. Manual - What ia the physical description of the manual and 
does it provide all the details that the evaluatox^ needs to 
know in order to use j|?he system? . 

Work Evaluation Process 

a. Preliminary Screening - What information is needed or uhat, deci- 
sions must be made before a client can be administered the 
system? ' • 

b. Sequence of Work Sample Administration - In what order are the 
work samples administered? . . . « 

c. Client Involvement - To what extent is the client informed of 
his/her progress during the course of administration? What 
type of formal feedback is given to the client after the entire- 
battery has been administered? What type of contact does the 
client have uith the evaluator? / 

d. Evaluation Setting - Does the general environment attempt to 
simulate industry, produce a classroom attppaphere, or resemble 
a formal tasting situation? * , 

e. Time to Complete the Entire System - How long does it take the 
average client to complete all the work iSampl'Ss in the system? , 

Admini-atration 

a. Procedures - Are the purpose of each- work sample, materials 
needed, lavout, and general instructions clearly given so that 
there is Mttle chance of misinterpretation? 
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b. Method of Instruction Giving - How daes the client teceive his/ 
. . her instructions for the work samples in the system, for ex- 
s ample: orql, demonstration, written instructions, or audio- 
visual? 

c» Repeating Dork Samples - lilhat provisions are made for the 

readminiatration of ,eome work samples'and what is the purpose 
of readministration? 

jd. Providing Assistance to the Client - What procedures are there 
for giving extra or additional instructions, demonstrations or . 
feedback after the period of initial .instructions? 

5. Scorino and l\torms- , " v j 

. a. Timing - lilhat are the procedures for |;iming^ the client? 

b. Timing Interval - When does. the evaluator start timing the 
client and whtn dpes he- stop? 

- c. Time Worms - What is the procedure for reporting the time 
scorfe for each work sample? 

d. Error Scaring - Uhat procedures, 'such as a random check of som^ 
parts, general rating of overall quality, or a comparison to 
'standards, are used for determining errors? ' ' 

B. Scoring Aids - Uibat'use ds made of overlays, templates, models, 
etc., to make scoring mote accurate and easier for the. evaluator? 

f • Qua.lity Norms - What procedures are used for reporting the 
^ ' number of errors, qualfty :^tlng, etc«>, for^ e'ach work sample? 

* g. Emphasis in Scoring - Dyes the system emphasize time or errors' 
in the scoring process? * • . ' 

0 

' 6. Observation of Clients 

• . •■ « 

a. Work Pterformance - Are work performance factors (e.g», fine 
finger dexterity, color perception) listed for the system and 
are specific work performance factors given for each taovk 

m sample? ' - \ 

• • • 

b. Work Behaviors'- Are work benaviors (e.g., ability to follow 
Instructions, communication with jsupervisors) defined for the 
system" and are specific work behaviors tti be observed for each 
work sample? * \ 

c. Ratirg System - What procedures does the system have for the 
-| , . recording, de9cri|)ing, and rating of observed work performance 

and work behaviors? _ v 

d. Frequency of DbsB"?vation - How often and to what extent is the 
evaluator to observe ^nd record client behavior? 

7. Reportino 

a. Forme - Ulhat forms 'are Included with the system? 
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b. Final Report Format - What informatiSn is included in the 

final report and nuhat type of format (e-q., rating scaltes, free 
V narration) is used to present the information? 

m 

a. utility 

a. 'UocaClonal Exploration - Does the svstem provide experiancea 

that the client can reaJJily relate to real jobs? 

b. Vocational Recommendations - Are trainiti'g and job recommen- 
dations specific or general?. Hou are they related to the DOT 
or other job classification systems? 

c. Counselor Utilization - Can the system provide the counselor 

^ or referring agency uith useful information &nd to what extent 
is the counselor involved in the process? 

" « . . - . w 

9. Training in the Syatem » 

B, Training Required - Is formal training' required before the 
system is sold? 

b. Training Available - Is formal training available? 

c. Duration - Hoy much time is required for training?' 

d. Folloy-up - Is technical assistance available after purchase 
a*hd training? 

10. Technical Considerations 

V ■ ■ « 

a. Norm Baae ~ ttlhat norjns are available and are the norm groups 
clearly defined? Are industrial norms (i.e., employed uorker) 
available? ' ^ 

b. Reliability - What empirical evidence is there to .demonstrate 
that the system gives reliable or consistent results? 

c. Validity - What empirical evideRce is available to indicate 
that the 8y,8tem really does what "tt, claims, such as make more 
realistic choices, job and training success; etc»? * 

11. Revieuier'a Stimmarv and Comments - This contsins what the reviewer 
considers to be the major advantages and disadvantages of the 
system. ' ..^^ 

• , * 

12. Address - The address of the manufacturer is given for those 
wishing to obtain additional information^ 

13. Coat - The "present cost^of th& system and what materials and serv- 
ices are included in the pric^. 

References - All generally available references are. given; those 
not available from the MDC Loan Service ape indicated by an 
asterisk (*). 
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Outline * 


KcCarron-Dial 


JEVS 


Singer 




Osvalopment 


• 

4 










• 

Sponsor 


McCarron and Dial 


U»S. Department of Labor 
a 


Singer Education Division 






Tartet Group 


mentally retarded and 
mentally ill 


disadvantaged 


not specified 




c. 


Basis of System 


^ neuropsychological 
factors 


DOT % 


not specified 




.Organization 






• 




a. 


Number ob york 


17 




20 . 






Grouping of 
ii/ork Samples 


'grouped into 5 factors 


10 morker Trait Groups 


each uor^c sample is 
independent 






Packaging of 
Ufork Samples 


some individually 
packaged 


all individually 
packaged ^ " ^ 


aelf-contatned in 
carrel 






Manual 


offset; contains all 
details 


offset; csiQta^ns all 
details 


printed; some details 
not provided 

> 


3. 


Uork Evaluatipn 






* 






* Preliminary 
Screening 


client interview 


not required 


not required 




b. 


Sequence of 
Adminialration 


in order by factora 


progressive from eaeAest . 
to hardest 


discretion of evaluator 




c* 


Client 
Involvement 


encouraged 


little client invQlvemsnt 


extenaive client 
involvement. 




d. 


Evaluation 
Setting 


formal testing and 
wdrkahop 


realistic ufork setting 
BtresBed ^ 


not Bpeciried 




t» 


Time to Cwnplete 
, En' ire System 


2 weeks 


6-7 days 


eatiftrate over 3 ueska 


u 


Adcnfnlstratiop 








f 




Procec^ures 


specified in detail 


specified in detail 


general procedure^ ^ 
described 




b. 


Method of In- 
etrtfction Giving 


oral and demonstration 


moat oral and 
demonstration 


audio-uiaual 




c. 


Repeating Ojork 
Samples 


faptor 3 rep^atefi if 
neteasary ' 


not recommended 


repeated if desired by 
evaluator 


- .... ^- 
• 




tTOviding As* 
Biatance to Client 


little asBiatance ^ 
provided 

i. 1 


assistance louiers score 
• 

* 


checkpoints built in 
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TAP 


TOWER 


V/ALPAR 


WREST 




• 

* 

Tslent AsssBsment 


• 

Vocational Rehabilitation 
Acflninistration 


t 

Valpar CnrporatiDn 


Guidance Associates of 
Delaware, Inc. 




not specified 


physically and enTotionally 
disabled 


inuuswr is^ ly in jureu 
workers 


noL speciTiec: 




occupational clusters 


job analysis 


trait and factor 


not specified' 




• 

11 


93 


12 


»■ ^ ' 

10 


• 


each tiiork sample is 
independent 


1tf training areas 


each work sample is 
independent; not grouped 


each work ^mple is 
independent 




all individually 
packaged 


not individually packaged 


all $ndividuallv 
pscksged 


not individually packaged 




offset; some details not 
provided 

r 


printed; some details not 
provided 


individual manual for ^ 
esch work sample; uffset, 
contains all details 


printed; contains all 
details 




not 8pocifi«d 


emphasized for planning 


not required 


• 

not specified 




a of the work samples 
gixAen in any order 


pragressivB within areas 


diacretiDn of evaluator 


in order by number 


ft 


not specified 
•* 


not specified 


not specified 


not specified 




not specified 


• 

realistic uiork setting 
f^tressed 


nor speci T i eo 


Hub BpcClTXSu 




2 1/2 hours 


3 ueeks 


estimate 12-15 hpurs 


1 1/2 hours 




not specified in detail 


I 

specified in detail, 
excfepu xayuUb 


^specified in detail 


specified in detail; can 
hp nrnun adrttini9t?p@d 




oral and det^onstration 


written instructions 


oral and demDnstration 


oral and demonstration 




not specif* sd 


encouraged for upgrading 


encouraged for upgrading 


emphasized for upgrading > 




little assistance 
provided 

•• 


not specified 

V 


not specified 


not specified 

1 



OutlSne 



5* Scoring and Nurma 
3* Timing 
b# TiminQ Interval 

c* Time IMorms 
d. Error Scoring 
e» Scoring Aids ' 
Quality Morma 



Q. Emphasis in 
Scoring 



McCarron-Dial 



evsluator times client 
feu tasks are timed 

no separate time norms 
uompared to standards 
not used 

combined with time norma 
for overall score 

quality 



client uses time clock 

from end of instructions 
to completion of task 



rated an 3-pDint scale 

compared to standards 

minimal use 

most rated cn 3-point 
scale 

time and quality given 
equal weight 



JEMS 



Singer 



evaluator times client 

varies with each work 
sample 



rated on 5-point scl 
compared to standards 
some use 

rated on 5-point scale 
quality 



6. Observation of 
Clients 

a* Ulork Performance 
b* lilork Behaviors 
c* Rating System 



d# Frequency of 
Observation 



some factqYs identified 

cxearly defined 

3 separate instruments 
used 

not specified 



25 factors specified 
clearly defined 
3-point rating scale 

extensive observations 



29 factors defined 

clearly defined 

general rating on 5-point 
scale for each work sample 

very frequent 



7. Reporting 
a« Forms 



h* Final Report 
Format 



standardized forms- for 
all phases 

profile of results and 
recommandations 



standardized forma for 
all phases 

standardized format; 
recommended Work Trait 
Groups 



standardized forms for 
all phases 

narrative 



a. utility 

a* Uocational 
Exploration 



b« V/ocational 

Recommendations 

c* CounselLr 
Utilization 



little use to client 



one of 5 program areas 
are recommended 



r^iaability 
determination 



limited use 



highly related to DDT 



orientated too/ard 
counselor \ 



extensive occupational 
information given to 
client 

emphasis on orientation 
to training 

orientated toward 
counselor 
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TAP 


TOUER 


VALPAR ^ 


OiREST 


evoluator tiiea client 

from end of Instructiona 
to cc^pletion of task 

actual time recorded 
nipt clearly defined 
not ubed 

combined uith time norms 
for overall ecore 

time 


evaluatjr times client 

from end of instructions 
to completion of task 

reted on S-point scale 
compared to standards 
extensive use 
rated on 5-point scale 

time and quality given 
equal uieight 


evaluator times client 

from end of instructiona 
to completion of task 

actual time recorded 
compared to standards 
some use 

time and error combined 
for performance norms 

time and quality given 
equal uieight 


evaluator times client 

usually from end of In- 
structions to completion 
of task 

actual time recorded • 
compared to standards 
not used 

all errors totaled for 
single quality score 

time 


no factors defined 
no behaviors defined 
no rating method used 

not specified 


few factors specified 
not* specifically defined 
S-point rating scale used 

not emphasized 


no factors defined 
17 'actors defined 
5-point rating scale used 

not specified 


no factors defined 
no behaviors defined 
no rating nethod used * 

not speCifiec^ 


standardized forma for all 
phases 

profile of results and 
narrative report 


at;.andardi2Bd forma for 
all phases 

narrative using stand- 
ardized outline and 
ratings 


standardized forms for 
recording performance 

not used; independent 
work samples 


• 

standardized form for 
recording performance 

not specified 


limited use . 

relied to specific jobs 

orientated toward 
counselor 


exposure to a variety of 
uork areas 

limited to jobs related 
to uorjc areas 

orientated touard 
counselor 


limited use 

limited use 
not specified 


■ — ■ r- 

limited use 

not specified 
not specified 
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9, Training in the 
System 

a. Training Required 

b. Training 
Available 

c. Duration 

d. Follouj up 



Vea 

1 to 2 ueeks 
No 



JEVS 



Vea 
Yeti 

2 ueeka 



Singer 



IVo 
Ves 

( 

2 wee»<s 



10. Technical 

ConaideratiDna 

3* IVorm Base 



b. Reliability 



c* Validity 



2D0 clients 



no data available 



procedures not adequate 
to draw concluaionB 



322 clients 



no data available 



puMlshed results 
favorable 



"more than 100 
individt4al8*' 

no data available 



no data available 
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V 



TAP 



Vm 
Vs» 

1 1/2 days 
not apeciried 



TOUeR 



Vet 

Ves 

3 weeks 
No 



UALPAR 



IVO 

» 

Ves 

Up tc 10 d^B 
as needed 



UREST 



No 
No 

not epplicable 

No 



7 different norm o^oups 



.85 coefficient of 
atsblllty 



no data available 
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clients 



no data available 



equiuocal results 



clients and workers 



test-retest uith fairly 
high eatimates 



no ilata auailable<^ 
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different age groups 
and employed uorkfra 

t6St«*reteBt and internal 
consistency estimates 
given * 

no data avaiiable 



McCARRDN-DIAL WORK EUALUATIDN SYSTEM 
(McCarron-Dlal) 

\. 

Development 

a. Sponsor - Lauirence T. KcCarron and Jack B. Dial. 

b. Target. Brnup - The mentally retarded and chronically mentally - 
ill. 

c. Basis of System - The system is based on five neuropsycholog- 
ical factors (see belou). ^ 

Organization 

a. Name and Number of Work Samples - The McCarron-Dial contains 
17 separate instruments, grouped into five factors: 

(1) Uei >al-Cognitive - Wechseler Adult Intelligence Scale 
(or Stanford-Binet Intelligence Scale) and thq^F^eabody 
Picture Vocabulary Test. 
• (2-) Sensory - Bender Visual Motor Bestalt TeoL and Haptic 
Visual Discrimination Tiast. 

(3) Motor Abilities - 

(a) Fine Motor Skills Assessment: Beads-in-Box; 
Beads-on-Rod; Finger Tapping; Wut-anjl-Bolt Task; 
and Rod Slide. 

(b) Bross Motor Skills Assessment: Hand Strength; 
Finger-Nose-Finger Movement; Jumping; Heel-Toe 
Tandem Itialk; and Standing on one Foot. 

(4) Emotional - Observational Emotional Inventory, 

(5) Integration-Cqping - San Francisco Vocational Compe- 
tency Scale and Dial Behavioral Rating Scale. 

b. "'Brouping of Work Samples - The testa., tasks, and scales are 

grouped according to five factors; all devices are closely 
interrelated. 

c. Packaging of (ilork Samples The tasks for the f^tor Abilities 
Factor, the Observational Emotional Inventory, the Dial Be-, 
havloral Rating Scale, the Peabody Picture Vocabulary Test, 
Bender Visual Motor Bestalt and the Haptic Visual Discrimination 
Test are packaged indepenciently. The lilAIS and the Stanford- 
Bihet must be purchased from their appropriate publishers. 

d. Manual - The bound offset manual j:ontains all system details. 
Iilork Evaluation Process 

a* Preliminary Screening - An intervieuj with the client and the 
referral source is urged to obtain background data on the 
client. 

b. Set^uence of ItlOrk Sample Administration - Administration begins 
uiith factor one and continues through factor five. 
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c. Client Involvement - Client involvement is encouraged during 

' the assessment period. Upon completion, the mstiual recQmmendB 
individual counseling to provide' help for the client to move 
toward realistic uork-training goala and expectations. 

d. Evaluation Setting - A formal testing setting is usec^t^for fac- ,^ 
tors one through three; the other two factors require a period ^ 
of placement in a udrk setting, most commonly a sheltered 
workshop. * . 

e. Time to Complete the Entire System - The first three factors 
can lae aaseesed in one day; two weeks of systematic observation 
in a work setting are needed to assess for the emotional and 
integration-coping factors. 

Adminiatration 

— ' ■ - » I II ' ij 

a. ' Procedures - Instructions, materials needed, layout and scoring 

procedures are all specified in detail. Standardized tests are 
administered according to instructions in their test manuals. 

b. Method of Instruction Giving - All instructions -for factor three 
are given orally and are accompanied by demonstration if needed. 
Factors dne and two are given according to their test manual 
instructions. 

c. Repeating Uork Samples - Factor three assesBments may be re- 
peated if the BvaluatoJ: questions the validity of the results. 

d. Providing Assistance to the Client - Evaluator is to make 
certain that the client fuliy- understanda thg instructions of 
each task; no assistance is given during formal testing (i.e., 
the first two factors). 

^Scoring and Norms " 

a. Timing - The evaluh^tor times the client. 

b. Timing laterval -,Few tasks are timed; those that are timed 
invbive counting the number of responses or accarate obser- 
vatign for a specified number of seconds. 

cr Time Worms - No separate time norma are preaented; time and 

•quality norma are combined and presented in the form of a single 
raw score. for each major task area. These scores are converted 
to percentile and plotted on a profile sheet. 

d. Error Scoring - The quality of performance is compared to a well 
defined set of standards. 

B. Scoring Aids - No scoring aids are used. ^. 

f. Quality Norms - See."c. Time Norms" above. 

g. Emphasis In Scoring - The system emphasizes the quality of. 
performance. 
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Dbservatlon of Clients / 

a* Unrk 'Perfoxmance - Some uotk performance factors are iden- 
tified an the various rating scales. 

b* Work Behaviors,- Work behaviors, as well as personal behaviors, 
are clearly s^cified and many specific uiork behaviors are 
\li8ted. Moat behaviors fire defined in obaervable behavioral 
terma« 

c» Rating fJyatem - The Observational Emotional Inventory, San 
Francisco Vocational Scale, and the Dial Behavioral Rating 
Scale all use a five-point acale to rate behaviors and per- 
formance factors; each form has its own sjiiC^tem of combining 
the individual ratings to form different scales. 

d. Frequency of Dbservatlon - Wot specified 
• Reporting - , ^ ^ 

a. Forms - Standardized forma are included for the assessment of 
■ many of the motor tasks, behavioral observations, aummary 

forms, and a profile, 

b. Final Report Format - The standard format includes p profile - 
of all results together uiith recommandations for appropriate 
training and/or work potential, ft narrative summary of the 
results for each of the five factors is albiJ presented. 

Utility 

a. Vocational Exploration - The formalized assessment procedures 
required fox* the first three factors offer almost no chance 
for client vocational exploration. The observation period 

-gi-ther-iTT-^t^ftt^hglte r e d tuor ka ho fi-oF-of^-a -job site .-coul^ provide 

chanoea for exploration, but this depends on the program of 
•each 'facility. 

'b# Vocational Recommendations - The system attempts to assess the 
client's ability' to function in one of the five follouiing 
program areas: day care, uork activities, extended sheltered 
employment, transitional sheltereii employment, and community ^ 
employment. Examples of finail reporta are provided 'to shou 
integration of results* Emphasia is on training and placement; 
no relet iOriahip to DOT. 

c. Counselor Utilization - the syatem is designed for disability 
detferminatlon and la 'aimed toward the counselor; counselor 
involvement is recomended. 

Tralnino in the Syatem 

a. Training Required - Yes 

b. Training Available - Yes 

c. Duration - One to two weeks contingent on the evaluator's exper 
rience. . , 

d. Follow-up - No 
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10. Technical ConBide^'^tiona 

. ^ a. Norm Base - Norms are avaUable on 2QQ adult "mentall/ disabled 
lndi\;lduals** in sheltered and conwnunity employment; some char- 
acteristics of the norm grpup art not given. No industrial 
norms are available. 

b. Reliabilllv No ^^^^ available , 

c. Validity - Although some regression equations are presented in 
the manual, technical information is not explained in sufficient 
detail to permit the reader to judge these research results. A 
thesis b.y Packard (1975) reports positive results. ^ 

11. Reviefaier*s Sunmarv and Comments - The McCarron-Oial u^as designed 
fqr the purpose of assessing the mentally disabled person Vs ability 
to function It uses a craobination of widely accepted individually 

V administered psychological testa, aasessments of fine and gross 

motor ability, and an extended period of Observation. Rather than 

- m * diacard those tests which have proven uaeful, or to^rely solely on 

performance and behavior observation i the McCarron-Dial attempts 
to combine them into a single prediction tool. The major problem 
appears to be. that no clear cutoffs or guidelines for making cutoffs 
are made* between the five program areas. 

12. Address • ~^ 

7" • • > ^ 

Commercial Marketing Enterprises.. 
Department : MpbJES 
11300 North Central, Suite 105 
Dallaa, Texas 75231 

- .13, Cost — i323.75 fj3r ^tJjB . ay stem, except. WAIS. and Stan.foxd-Binet; 

tlW.OO for 100 copies of all forms. Add 1056 for, shipping and 
handling.- 

14. References , ' * • 

♦McCarron, L. T., & Dial, J. G., NeuropsychologJ.cal predictions of 
sheltered workshop performance. American Journal of Mental 
Deficiency , 1972, 77, 2t»<f-250. 

Packard, R. A., A pre-admission screening battery: A concurrent 
validation df the McCarron-Dial Work Evaluation System'. Un- 
pViblishad maatera thesis. University of Texias, Health Science 
Center, Dallaa, Texas, 1975. 

tTimmerman, .1., & Doctor, A. C, Special ao olicationa of work 
evaluation techniouea for prediction of emplovabilit v of the 
trainable raentaXly retarded. Stryker, Ohioi Quadco Reha- 
bllltatlon Center, Inc., 197t». 
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PHILADELPHIA JEWISH EMPLOYMENT AND VOCATIONAL SERVICE 
* liiORK SAMPLE SYSTEM (JEWS) 

Development 

a. Sponsor - U.S. Department of Labor 

b. JaVget Group - Originally designed- for the disadvantaged, th2 
system is notu being adapted for the disabled. • 

c. Basis of System - The Worker Trait Group Organization of The 
Dictionary of Occupational Titles (DOT). 

Organization 

a. Name and Number of Work Samples - The system "contains 28 work 
samples arranged in ten Worker Trait Groups as follows: 

(1) Handling - Nut, Bolt and Washer Assembly; Rubber Stamping; 
Washer Threading; Budgette Assembly; and Sign Making. 

(2) . Sorting, Inspecting, Measuring and Related Work - Tile 

Sorting; Nut Packing; and Collating Leather Samples. 

(3) Tending - Grommet Assembly. 

ik) Manipulating - Union Assembly; Belt Assembly; Ladder 
Assembly; Metal Square Fabrication; Harduare Assembly; 
Telephone' Assembly; and Lock Assembly. 

(5) Routine 'Shecking and Recording - Filing by Number; and 
Proofreading. * ' 

(6) Classifying, Filing, and Related Work - Filing by Three 
Letters; Nail and Screw Sorting; Adding Machine; Payroll 
Computation; anf Computing Postage. 

(7) Inspecting and Stock -Checking— Resistor -Reading. ■ 

(8) Craftsmanship and Related Work - Pipe Assembly. 

(9) Costuming, Tailoring, and Dressmaking - Blouse Making 
and Vest Making. ■ ^ ' , 

(10) . Drafting and Reiated Work - Condensing Principle. 

b-. Grouping of Samples - The Work .samples are grouped into ten 
Worker Trait Grouns. 

c. Packaging of Work Samples - Each work. sample is individually^ 
packaged. * / . 

d. Manual -^The offset manual with photographs contains complete 
system details. 

Wo rk EvBluatian Process 

a. Preliminary Screening - Not required 

b. Sequenpe of Work Sample Administration - Work samples are ad- 
ministered progressiwely with the client atarting with the 
simplest work sample and proceeding in order through the ayatem. 



Client Involvement - Bbcbubb uork sample admlnlatration re- » 
aemb'lBB a fqrmal testing situation, olient contact with the 
evaluator is minimi zed j feedback on performance and behavior 
occurs at the end of the evaluation proceas. 

d* Evaluation Setting - A iealiatic work atmosphere and setting 
are streamed in the manuaU 

e. Time to Complete the Entire System - The average client takes 
six or seven days. 

Administration 

a. Procedures - The material re.iuired and layout are clearly des- 
cribed; photographs are uaed to insure proper Jayout. 

b. Method of Instruct'ion Giving - Most instruct iorjs are oral and 
demonstration; written Instructions are used only when reading 
is a requirement in a job area being sampled* 

,c. Repeating .Uork Samples - Readministration is not recommended 
because it invalidates results. 

d. Providing Assistance to Clients - Assistsnce can be given after 
the initial instruction, period; but this results in lowering 
the client's final score. 

Scoring and Worms 

a. Timing - The client uses a time clocktfor each work sample. 

b. Timing Interval - The evaluator punches the time clock after 
instructions are .given, and the_cli.ent punches the clock whpn 

■ tha work sample iH trDmpIetBcn 

c. Time Norma - Time' results are r^ted on a three-point scale 

based on the number of minutes to completion. 
• 

d. Error Scoring - Most work samples use a random check of items 
which are compared to carefully de^ed scoring criteria; 
some USB photographs to illustrate quality standards. 

e. Scoring Aids - Minimal uss is made of • acoring aids. 

f. Quality Norma - Most work samples use, a three-point rating 
scale based on the number of counted errors; others use a 
correct-incorrect dichotomy. 

g. Emphasis in Scoring - Time and quality are given equal weight. 
Observatian of Clients ^ 

a. Work Performance - Twenty-five work factors are specified for 
the system; each work sample has certain factors listed ttjat 
are to be observed. 

b. Work Behaviors - All work behaviors to be observed are oare- 
fully defined. 
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c. Rating System - Manv of the 25 work perfDrm&nce" factors are 
ratBd on a three-point scale; with al-l ratings dearly dBflned 
and Illustrated. 

d. Frequency of Observation - The system uses extensive obser- 
vations. Observation of defined uork factors Is required for ' 
each Liork sample; these are summarized dally. 

7. Reportlnq 

a. Forms - Standardized forms are Included for work sample re- 
cording, dally observational summary, feedback Interview and 
final report. 

b. Final Report Format - The atandardlzed format Includes the 
ranking of work sample performance, recummenderf Worker Trait 
Groups and rationale, and extensive uritten comments on per- \ 
formanc^ and behavior. 

8. * Utility " •; : 

a; Vocational Exploration - There Is limited- opportunity because 
many of the uork samples tend td be abstract. 

b. Vocational Recommendations - Vocational recommendations are 
ftlghly related tq the DDT; cover a wide range of Jobs, ai^ are. 
geared for both 'training and jpb placement. 

c. Counselor Utilization - The systfem and the final report are 
orientated towarc^ the counselor; hifweyer, counselor familiarity 
uiItK^t1iB~D0T is necessary for"^ use." 

9. Training Required . > ^ 

a. Training Required - Ves , 
. - b# Training Available - Yes 

c. Duration - Two weeks 

d. Follow-up - Two technlc'al aselstance visits are made^ to aasist 
with the establlafMueht of the system and the maintenance of 
standardized procedurea. 

10. Technical' Considerations 

a. Norm Sage -.-The system was noxfmed on 322 clients, mainly young 
black males; the' sample is clearly deacribed. No industrial 
norms are available. 

b. Reliability - No published data available 

c. Validity - Although the Initial study of the system gave favor- 
able evldenpe, results of atudlea done by the U.S. Department 
of Labor h^e not been released to the public. Research by 
Nsdolsky (1973) concludes that the system Is valid for eval- 
uation of Immediate employment potential. 
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.11, Re vietiier' s Sunwnarv and CotwnentB - The JEWS aystem is a highly J 

standardized and well integrated, procedure for client evaluati\jn 
based on ten of the DOT Ulprker Trait Groups. The system empha- 
, sizes the accurate observation and recording of work behaviors and ^ 

perfarroance factora. The major proble»a with the system appear to 
V be the abstract nature* of many of the work samples, which hinders 

VQcatiojal exploration, limited evaluation feedback to the client, 
and the lack of job information presen**Bd to the client. The • 
• systam^'is perhaps 6eot used whfcn a thrrough. evaluation of the 
client's potential is ^eaired. 

12. Address 

Vocational Research Institute 
• • Jewish' Employment end Vocational Service ^ 
1913 Olalnut Street 
Philadelphia, Pennsylvania 191D3 

\ 13. Cost - $6,1^0.00 includes all work samples and forms, shipping, 

tuition for training one person in' Philadelphia and two site visits 
(transportati^ of JD/S Staff person not included). 

1f». Referencss 

American Vocational Association. Manpower, human asRessment and 
the disadvantaged: A consumer report on the use and misuse of 
atandardizgd testintfi American Vocational Journal . >1973.'4fl (1), 
85-100. ^ 

Backer, T., Methods of assessino the disadvantaged in manpower 
- programs: A review and analysis . Los Angeles: Human Inter- 
action Research Institute, 19':'2. 

. - ' Drachman, F., & Kulman, H., New developments .in the Philadelphia 
JEVS Work Sample Syatem. Vocational Evaluation and litork 
• Ad.luatment Bulletin . 1973, 6 (1), 21-2if. 

fiennlken, 0., Time-quality performance of Goodwi.>.l clients evaj^- , 
uated by the JEVS Work Sample Battery. Vocational Evaluation 
and Work Ad.luatment Bulletin . 197f», 7 (3), 3-16. 

Golds M., Factora affecting production by the retarded: Base rate. 
'Wental getardation . 1973, (6), k^-k5, 

Jewish Employment and Vocational Service, Work samples; Signposts 
on the road to occupational choice . Philadelphia: Author, 1968. 

♦Jewish Employment and Vorjational Service* The development of time 
and quality norms fO' the Philadelphia JEVS Work Sample SyatemT 
Philadelphia: Author, 1973. 

Hulman, H., The Jewiah Employment arid Vocational Service Work Sample 
Battery. In A. Sax (Ed.), Innovations in vocational evaluation 
and work adjustment; Vocational Evaluation and Uork Ad.luatment 
Bulletin . 1971^ ji (1), 25-27, — — 
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McHugh; P., Mem agproaeheB \n uork aample utilizBtion . New Yorki 
The Experimental Manpower Laboratory *3t Mobilization for Youth, 

Morley, R. v.£d.), Vocational agsessment avBtewS .' Dee Moines: State' 
of loua, Department of Public; Inatruction, 1973. 

* 

Wadnlaky, u., Uocational e\/a3'uation of the culturally disadvantaged : 
A compBrative invest iqa.t ion of the JEVS svatem and a model-tiBBed 
3V3t#n. final report . Auburn, Alabama: Auburn University, 
.School of Education, Departiient of Uocatiopal and Adult Education, 
1973. 



Orr, 8., liJork gample evaluation development pro.lect . P^iiladelphia: 
JewlBh Employment and Vocational Service, 1972. 

Plax, K. (Ed.), An evaluation of the Philadelphia 'JEVS Work Sample 
Battery. Research Bulletin . St. Louis Jewish Employment and 
"Vocatitfhal Service, August, 1972. 

Rottenstein, R., & Small, j., Midwest adaptation of the Philadelphia 
• (liork Sample System . Chicago: Jewish Vocational Service, 1973- 

Spergel, P., Vocational evaluation: Research and implications for 
maximizihg human potentials. Journal of Rehab'ilitation , 197Q, 
36 (1), ZU^h. 

Spergel, P., Asseasment of the disadvantaged. Vocational Evaluation 
and Ulork Ad.l^etwent Bulletin . 1970^ 3 ('1), 8-1ff. 

Spergel, P., & Leaf" t^v, 5., Vocational assessment through work 
- sampling. Journ of Jewish Eommunal Service . 1966, Mt, 225-229. 
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SINGER VOCATIONAL EVALUATION SYSTEM 

* 

(Singer) 



DeveloDment 

a. Sponabr - Singer Education Division 

b. Target Group - Not Specified 

c. Baaia of Syatem - Not apecified 

Droanization 

a* Name and Number bf Work Samplea - At preaent the follouiing 19 
work aamplei are contained in the syatem: 

(1) Sample Making; (2) Bench AasfiUaly; (3) Drafting; C^f) ulec- 
trical Wiring; (5) Plumbing and Pipe Fitting; (6) Carpentry; 
^ (7) Refrigprat^on, Heating and Air Conditioning; (B) Soldering 
and Welding; v*:) Office and Salea Clerk; (10) Needle Tradea; 
(ai) Maaonry^ (12) Sheet Metal; (13) Cooking and Baking; 
(14) Engine Service; (15) Medical Service; (16) Coametology; 
(17) Data Calculation and Recording; (18) Soil Teating; 
(19) Photo Lab Technician; and (20) Production Machine Operating. 

hi Groupirig -of Samples - Each- work .aample is lodep.enfiient . _ _ 
c. Packaging of Work Samples - Each work sample is self-contained 
in a carrel. 

Manual - The printed manual is bound in a looaeleaf folder; 
some syatem details (e.g., report preparation and interpre- 
tation) are not provided. 

Work Evaluation Process 

a. Preliminary Screening - Not required 

b. Sequence of Work Sample Administration - The order of adminis- 
tration is left to the discretion of the evaluator. 

c. Client Involvement - The client is extensively involved in the 
eveluation process through a system of self-ratings of interest 
and performance. Due to the frequent number of checkpoirits in 
each work aample, client contact with evaluator is high; little 
proviaion for accurate -feedback exists. 

d. Evaluation Setting - Not specified 

e. Time to Complete the Entire System - Not specified (reviewer 
estimates over three weeks if all 20 work samples are given) 

Administration 

a. Procedurea - The general administration procedures are described 
for the entire battery; the tools and supplies needed for each 
work sample are clearly listed. 
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Method of Instruction Giving - All instructions are given using 
an audio-cassette tape and film strip format, tuith .the client 
controlling the rate of advancement. This programmed material 
is occasionally supplemented uith uiritten material. 

♦ 

c. Repeating Uork Samples - ttiork aamples may be repeated if desired 
by the evaluator. 

d. Providing Assistance to the Client - The evaluator is encouraged 
to make sure that the client knoya hout to do the task before he 
begins to uork; checkpoints are provided in the audio-visual 
material so that the client can ask the evaluator to revieiu his 
progress before continuing. 

Scorino and IVorms 

a. Timing - Evaluator times client. 

b. Timing Interval - The interval varies uiith each uork sample and 
is specified for each ulsrk sample in the manual. 

c. Time Norms - The results are rated on a five-point scale, based 
on the number of minutes to completion. 

d. Error Scoring - All items are checked against a carefully defined 
scoring criteria. 

e. Scoring Aids - Some use is made of scoring aids. 

f. Quality Norms - Quality norms are rated on a five-point scale, 
based or the actual number tjf errors* 

g. Emphasis in Scoring - Emphasis is on the quality of the finished 
product. 

Dbservatian of Clients 

a. Work Performance - Twenty-nine work factors (taken mostly from, 
tha DOT interest and temperament factors) are defined and each 
uork sample has certal.. factors listed that are to be observed. 

b. (liork Behaviors - The utork behaviors to be obierved are defined. 

c. Rating System - Client and evaluator both rate client's perform- 
ance on a five-point scale for each uiork sample; the rating is 
general and does not include separate ratings of specific uork 
factors or work behaviors. 

d. .Frequency of Observation - Frequent observation is required due 
to checkpoints in the system. 

Reporting 

a. Forms - Standardized forms are included for intereat ratings, 
performance ' rating, a picture interest test, and a summary sheet. 

b. Final Report Format - A narrative report with attached forms- Is 
recommended. 
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8. ^ Utility 

a. Vocational ExplQ^-atian - An extenaiue amount of occupational 
information la provided to the client; each work sample containa 
an iritroduction. to some Jobs related to the work sample, 

b. Vocational Recommendationa - The aystem is roughl% related to 
the DOT through Occupational Group Arrangements; the major 
eniphasia ia on orientation to job training. 

c. Counsplur Utilization - The final report is aimed for the 
|Our»sBlor. . 

9. Training in the Svatem . " ■ 

a. Training Required - No 

b. • Training Available - Ves ^ 
c# Duration - Two weeks 

d. Follow-up - None 

10. Technical ConBiderations 

a. Norm Baae - Soma work samples were normed on "more than 100 
individuala"; inadequate information given on norm group. No 
industrial norma are available. 

b. Reliability - No data available 

c7 UalTdlty - No data availatJlB - 

11. Reviewer* a Summary and Comments - The Singer system presently con- ■ 
eista of 20 work samples that provide the opportunity to evaluate 

a client for mr/...; job areas - mostly in the skilled trades. The uae 
of intereat mt^^-jifea and occupational information makes the client 
aware of a wide variety of jobs. These career exploration and 
occupation information' functiona are the strong points of the system; 
often at the expense of the evaluation of client potential. Many 
procedurea for using the system are not clarified in the manual and 
the ayatem is not aa integrated into a functional whole. 

12. Addreaa 

Singer Education Division ' 
Career Syatems 
60 Commerce Drive 
Rochester, New Yotk U623 

13. Coat - $22,935 for 20 work samples, evaluation package, installa- 
tion and orientation; Singer usually will not aell lesa than ten 
work samples initially, eatimated cost for ten is tl3,D00. Training 
not included. 
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TALENT ASSESSMENT PROGRAMS 
(TAP) 

• > 

Development 

a. Sponsor - Talent AasesBment Programs 

b. Target Group - Not specified 

c. Baals of Syatem - Occupational cluatera of related jobs 
Droani'zation 

a. Name and Number of Work Samplea - Eleven testa are included in 
the syatem: 

<1) Structural and Mechanical Visualization j ,(2) jplacrlroination 
By Size and Shape; (3) Discrimination by Colors;^ ^f) Tactile 
Discrimination; (5) Fine Dlacrlmlnatlon without Tools; (6) Groaa 
Dexterity ulthout Toola; (7) Fine Dexterity with Tools; (B) 

Gross Dexterity with Tools; (9) Circuital UlsuallzatLlon; 

(10) Retention of Structural and Mechanical Detail; and (11) 
Structural and Mechanical Visualization In Greater Depth. 

b. Brounlng of Work Samplea - Eachuork aample Is Independent. 

c. Packaging of Work /Samples - All work samplea are packaged 
Individually. 

d- ManuaT - A spiral-bound offset manual with illuatrationa contains 
aome ayatem details (e.g., manual doea not apeclfy materials for 
each taak and client admlnlatratlon Inatructlona are preaented 
only In outline form). 

(ilork Evaluation Process 

a. Prellrtilnary Screening - Not specified 

b. Sequence of Uork Sample Administration - Work sample no. 1 must 
be given Vlrst and work samples nos. 10 and 11 last; the other 
taska may tie given In any order. — . 

c. Client Involvement - The type and degree of client Involvement 
during administration is not specified. Because of the short- 
ness and formal nature of the tests, there Is probably little 
client Involvement. The client Is given a copy of his scoring 

• profile upon completion. 

d. Evaluation Setting - Not specified 

B. Time to Complete the Entire Battery - The testa can be admin- 
istered In from two to two and dne-half hours. 
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Administration 

^. Procedures - The materials^ tools layout^ as uell as the 

exact client instructions and demonstrations are not specified 
ih detail. The last uork sample is administered only to 
clients' uho .have performed extr^ely uell on uork samples nos. 
1 and 10; the developer estimates that only 10% of all clients 
should take the final uork sample* 

b» ..Method of Instruction Giving - All instructions are given orally 
uith appropriate demonstrations; no reading is required*. 

c. Repeating Work Samples - Not specified 

d. Providing Assistance to the Client - The evaluator is to make 
sure* that the client fully linderstands^ the task before timing 
begins. r ' 

Scoring and Worms 

a. Timing - The evaluator times the client using a digital, decimal 
minute timer. 

b. Timing Interval - Timing begins when the client fully understands 
the « instructions and stops uihen the task is completed. 

c. Time Norms - The actual completion time to the nearest tenth of 
a minute ia recorded. After any •♦penalty" airores have been 
added to the completion time, the total rau time score is com-> 
pared ta percentile norms. * 

d. Error Scoring - Errors are not plearly defined in the manual. 
' Apparently the e'ntire task is checked for errors. Four uork 

_ sahtples are not scored for errors. 

e. Scoring Aids - No scoring aids are used. 

f* Quality Norms - There are no separate quality norms. In those 
uork aamplea uhich are scored for errors , the nwiber of errors 
is multiplied by a conataht number and the resulting ''penalty** 
is added to the rau time score. 

g. Emphasis in Securing - Emphasis is on time scores. 

Observation of Clienta ^ 

a. iiiork Performance - A feu uork performance factors are mentioned 
but none are defined; no information is given for their obser- 
vation. 

b. Uork Behaviors - A feu uork behaviors aj;g^entioned but none 
are defined; no information is given for their observation. 

-c. Rating System - No method of rating behaviors is used. 

d. Frequency of Observation - Not specified 
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ReportlnQ 

a. Forms - A raui score form, a form for recording job pOBSibilitlefi 
by Occupational Clusters, and a profile sheet are used. 

b. Final Report Format - The profile sheet contalnfl a profile of 
the percentile aiporep for each work sample, except no. 11, a 
Talent Quotient (baaed on the total results) and a space for 
a narrative report that interpteta the profile and gives 
vocational recommendations. 

Utility * 

a. Uocatlonal Exploration - Because the work samples are really 
standardized perceptual and dexterity tests, they are too ^ 
abstract to provide much direct vocational information to the 
client, without interpretation by the evaluator. 

b. Vocational f^ecommendationa - Using occupational, clusters the 
manual lists specific Job titles with DDT codes within each 
cluster together with the work samples that relate to specific 
job requirements. ■■ ^ 

c. Counselor Utilization - The profile sheet with its occupational 
recommendations is designed for the counselor, teacher, or ^ 
employer. 

Training in the System 

a. Training Reflulred - Yes 

b. Training Available - Yes ^ 

c. Duration - About a day and a half 
d* Follow-up - Not specified 

Technical Considerations 

a. Norm Base - Norms are available for: (1> male senior high school 
students; (2) female senior high srhool students; (3) male junior 
high school students; M female junior high school students; 

(5) a mi^ed sex group of mentally retarded adults; (6) unselected 
employed young adults; ahd (7) male alcoholics. All groups are 
of adequate .size, but some details of group characteristics are 
not given. j 

b. Reliability - The developers report a coefficient of stability 
of over .85 in preliminary test-retest studies over a six month 
period; however, not enough of the procedures are given to fully 
judge the meaning of these results. 

c. Ualidity - No data available. 

■ * « 
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11, Revleuier*8 Sufwnarv and Comments - As opposed to other york eval- 
uatlon systems uhich aMempt to present a complete picture of the 
client, the TAP can be characterized a$ a i}atterv of perceptual and 
dexterity tests designed to measure gross and fine finger and ^ 
manual dexterity; visual and tactilq discrimination; and retention 
of details. Thus, It is limited to the assesBment of these fairly 
specific factors. The developer does not claim that this system 

' will assess all vocationally signifisj^ant capacities and" behaviors; 

in .fart the manual states that other assessment devices should be 
. used in addition to the TAP to oblipln a complete evaluation of the 
client* 

12. Address \ « 

Talent Assessment Programs 

7015 Colby Avenue , 

Oes Moines, loua 50311 

Cost " $2,^00 to 12,900 depending upon distance from Des Moines; 
^ price includes on-site staff training. 

14. References 

Morley, R. (Ed.), Vocational assessment systems . Des Moines: State 
of Iowa, Department of. Public Instruction, 1973. 

Zikmund, D., & Reinders, L., Talent Assessment Program Test Battery* 
(sic) In A. Sax (Ed.), Innovations in Vocational; Evaluation and 

fatork Ad;ja 8 tm e n t. — Vocational Evaluatitrtv-and-bterk AAHtatinent 

• Bulletin, i97f», 7 (4), "SB-SI. 
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THE TOUIER- SYSTEM 
(TQUER) 

• ■ * • • 

DBvelopment 

a* Sponsor - Vocational Rehabilitation Admin ietrat ion 

b. Target GrouDZ-'Dkeigned for the physically and emotionally 
diaabled. / 

c. Basis of System - 3ob Analysis 

« 

OrQahization ^ ' . 

a. Name and Wumber of Ulork Samples - The system contains 93 work 
samples arranged into I** job training areas: 

(1> Clerical - Business Arithmetic; Filing; Typing; One-Hand 
Typing; Payroll Computation; Use of Sales Book; Record 
Heeping; and Correct Use of English. 

(2) Drafting - T Square; Triangle; Compass; Working Drawing; 
drawing to Scale; and Beometrlc Shapes. 

(3) Drawing - Perspective; Forms, Shapes and Objects; Shading, 
Tone and Texture; Color; .and Free Hand Sketching. 

M Electronica Assembly - Color Perception and Sorting; 
Running a Ten tilire. Cable; Inapeoting a Ten Wire Cable; 
Lacing a Cable; and Soldering Ulres. , 
- <5>-aeu«lry Wamifacturingjr-Jiae_JDLf ^Sa^^^ NeedlB_Fll_eBi_^_ 
Electric Drill Press; Piercing and Filing Metsls; Use of 
Pliers; Use of Torcr^ in Soldering; and Making Earring and 
Broach Pin. - * • 

(6) Leathergoods - Use of Rulers; Use of Knife; Use o^ Dividers 
Use of Paste and Brush; Use of Scissors and Bond Folder In 
Pasting; Constructing Picture Frame; and Production Jask. 

(7> Machine Sholp - Reading and Transcribing MeBsurements; 
Blueprint Reading; Measuring with a Rule; Drawing to 
Measurement; Metal Layout. and Use of Basic Tools; Drill 
Press Operation; Fractions and Decimals; Measuring with 
the Micrometer Caliper; and Mechanical Understanding. 

(8) Lettering - Lettering Aptitude; Alphabet and Use of 

T Square; Use of Pen and Ink; Use of Lettering Brush; and 
Brush Lettering.' „ « 

(9) Mail Clerk - Opening Mail; Date-Stamping Mall; Sorting 
Mall; Delivering Mail; Collecting Mall; Folding and " 
Inserting; Sealing Mall; Mall Calssiflcatlon; Use of Scale; 
and Postage Calculation. ^ « 

(10) Optical Mechanics -fUae of Metric Ruler; Use of Calipers; 
Lens Recognition; Lens Centering and Marking; Use of Lens 
Protractor; and Hand Beveling and Edging. t 

(11) Pantograph Engraving - Introduction to the Engravograph; 
Settlng-Up, Centering Copy and Determining Specified 
Ratioa; Use of Uorkholder and Adjustment of Cutter; and 
Settlng-Up and Running Off a Simple Job. 
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(12> Sewing Machine Operatjing - Sewing Machine Control; Use of 
Hnee Lift and Needle Pivoting; Tacking and Sewing Curved 
" Linea; Upper Threading; Winding and Inaerting Bobbin; 
Sewing and Cutting; and Top Stitching. 

(13) Uelding - MeaauJ^ing; Making a tdorking Drawing; Identifying 
ttlelding Rods; Use of Acetylene Torch; Uae of Roda and 
Electrodes; Use of Tprch and Rod; Measuring and Cutting 
Metal; and Soldering. , . 

Cltf) Workshop Aasembly - Counting; Number' and Color Collation; 
Folding. and Banding; Ueighing and Sorting; Counting and 
Packing; Washer Assembly; Inserting, Lacing and Typing; 
and Art* Paper Banding. 

b. Grouping of Work Samples - The work samples are grouped into 
major areas^of training. ' " 

c. Packaging of Work Samples - The worl<: samples are not individually 
packaged. • " 

d. Manual - The printed manual is bound in a looseleaf folder. 
Some system details are not provided, but are covered In a 
aeparate book, TOWER. 

Work Evaluation Process . 

a. Preliminary Screening - This is emphasized for planning purposes," 
but the apecific information needed prior to administration of 
the system is not specified. * ■ , 



b. ~ Sequence oTWrk Si^ Administration - Administration is pro- 

gressive within the major areaa; the choice of areas* depends 
upon client interest and/or the evaluation plan. 

c. Client Involvement - No client involvement procedures are spec- 
ified in the<»reanual. 

d. Evaluation Setting - A realistic work atmosphere and setting are 
stressed. 

' . ' ■ ■ 

e. Time to Complete the Entire System - The average client completea 
the entire System in three weeks; however, clients seliiom take 
all work samples in the system 

» 

Administration ^ 

a. Procedures - The purpose and procedures' are clearly described. 
All tools and jnaterlala required are listeB; hqwever, some lay- 
out details are not given. 

b. Method of Inatruction Giving - Tne system uses mainly written 
instructiona which are supplemented by evaluator explanation 
and demonstration when needed. 

c; Repeating Work Samples - The readmini^tration of work samples 
is encouraged Tor the purpoae of upgrading client performance. 
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d* Providing AsslstaRce to the Client - The evaluator Is encour- 
aged to engure^the client knows how to perform thf!* task before 
he begins to work; procedures for assisting the client after 
he has started the task are not specified. 

Scoring and Norma 

a. Timing - The evaluator times the client, but no procedure for 
timing Is establiahed. 

b# Timing Interval - Timing begins following instruction and 
stops upon completion of the task. 

c. Time Norma - Time results are rated on a five-point scale, 
based upon the number, of minutes tP completion. 

d. Error Scoring - All items are checked against carefully"* defined 
scoring criteria. 

e. Scoring' Aids - Extensive use is made of transparent overlays 
and other scoring aids. 

f. Quality Norms - All work samples are rated on a five-point 
scale, ba^ed upon the number of errors. 

g. Emphasis in Scoring - Time and the quality of the finished 
product are- given equal weight. 

Dbservatlon of Clients 

a. Work Performance - Few work , factors are specified and none are 
specified for Individual work samples. jjj^ 

b. Work' Behaviors - Work behaviors are not specif IcaSfdefined. 

c. Rating System - A five-point system is used to rate" "work and 
personal characteristics"; the points on the scale. ai« not 
clearly defined. 

d. Frequency of Obaervation - Frequent observations are not empha- 
sized, but are taken for granted. 

Reporjilnq 

a. Forms - Standardized forms are used for attendance and punc- 
tuality; for a summary of time and quality results for each 
work sa^nple; snd for a •♦vocational evaluation report." 

b. Final Report Format - The final report contains a narrative 
summary using a standardized outline and a section containing 
mainly global ratings of the client. Personal contact with 
the counselor is recommended. 

ytllitv 

a. Vocational Exploration - The client is exposed to many different 
training areas which pre {repreaentstive of a variety of Jobs; 
The manual contains specific occupational information that is 
given during the administration of the work samplea. 
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b* "Vocational* Recommendations -Vocational recommendations are 
limited to Jobs dihich are directly related to the uork samples. 
The recommendations are not highly related to the DOT and are^ 
primarily treining orientated* 

c» Counselor Utilization —Counselor involvapient in the evaluation 
process is recommended; the final report is aimed at the 
counselor. 

9. Training In the System 

a. Training Required - Yes 

b. Jraining Available - Yes 

c. , Duration - Three uieeks 

d. Follow-up - No - ^ |. 
10, Technical Considerations 

a. ^ Norm Base - The system uas normed on clients at the Institute 

for the Crippled and Disabled CICD); sample sizes or character- 
istics are not given. Industrial norms are not available. 

b. ReliablJ^ity - No data available. 

c. Validity --A' seven city research study produced equivocal 
results. — : - 

11 y Revietuer*a Summary and Comments - Thfe TOWER System is the oldest 
complete uork «valuatlon system and over the years has served as a 
model for the development of many uork samples. The TOitiER uses a 
realistic job setting to thoroughly evaluate" clients for a rather . 
narrow group pf jobs. The facts that the TOWER was based on job * 
analysis and that the system has been used for many years to place 
and train handicapped people are indications that the system is 
very useful in evaluating clients for a small group of jobs. The 
lack of precise definitions for work performance factors and client 
behaviors and the lack of adequate norms are the major weaknesses . 
of the system. The high use of* written instructions and the high 
level of the areas evaluated restricts its use with low lltera'te 
and mentally retarded clients. 

12. Address • ^ 

ICD Rehabilitation and Research Center 
3kQ East 2kth Street: 
New York, New York 10010 

Cost - $300.00 for three copies of all work samples and forms; 
training tuition la 1150.00, which Includes manual. Note: No 
hardware is sold by ICO, each facility constructs the work, 
samples. ICD estimates cost to set iip unit at about SS(,OOO.OQ. 
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UALPAR COMPONENT lilURK SAMPLE SERIES- 



(UALPAR) 

Develapment 

a. Sponeor - Ualpar Corporation 

Target Group - Industrially T.-ijurBd liforkers 

c. Basis of System - Trait-and-factor approach based on task 
analysis* 

Drqanization 

a. Wumber of UJork Samples - At present the follouing 12 ujork 
samples are contained in the system: 

(1) Small Tools (Mechariical) ; (2) Size Discrimination; 
(3) IMumerical^Sorting; (A) Upper Extremity Range of Motion; 
(5) Clerical Comprehension and Aptitude; (6) Independent- 
Problem Solving; (7) Multi-Level Sorting; (8) Simulated 
Assembly; (9) Whole Body Range of Motion; (1D) Tri-Level 
Measurement; (11) Eye-Hand-Foot Coordination; and (12) 
Soldering, 

b. Grouping - The work samples were developed and are intended 
for use as individual components and are not grouped as an 
evaluation system. 

c. Packaging of Work Samples - Each work sample ia self-contained. 
Most are packaged in lockable cases. 

cU Manual - Separate spiral bound, "offset manuals are provided 
for each work sample. Each manual contains all details 
necessary for that particular component, 

tJork Evaluation Procees - 

a. Preliminary Screening - Not required 

b. Sequence of Work Sample Administration - The order and number 
of work samples administered is left up to the discretion of 
the evaluator. 

c. Client Involvement - Because work sample administration re- 
sembles a formal testing situation, client involvement is 

- minimal; feedback on performance is left up to the discretion 
of the facility and irvilvidual evaluator.' 

.d» Evaluation Setting y Mot specified 

e. Time to, Complete Entire System - Not specified; note that this 
is a group of components not a system. (Reviewer estimatea 
12-15 hours for all 12 units.) 




Admlnlatratlon 



a. Procedurea - The raaterial required, inatructions to evaluator, 
and layout are clearly deacribed in the manual; detailed 
drawings are uaed to inaure understanding. 

b. Method of Instruction Giving - All instructions are oral and 
demonstration J reading is not required except when necessary 
to. perform the given task. 

c. Repeating Work Samples - Readministration is encouraged for 
upgrading, if desired by the evaluator. 

d. Providing Aaaistance to Client - The evaluator is encouraged to 
insure the client has a thorough understanding of the taak 
before beginning. Practice trials are given as part of the 
inatructiona on everV work sample, and a clear understanding 
should exist before starting on the task. The manuala do not 
specify assistance to the client after timing has started. 

Scorino and Norms 

a. ' Timing - Evaluator times client. 

b. Timing Interval - From the end of instructions to completion of . 
the task. 

c. Time Norma - Completion time in seconds is recorded for each 
portion of all tasks and for disassembly. The total time iS/ 
converted to percentile norms. 

d. Error Scoring - Errors are well defined; the number of errors 
ia recorded for each part of the aample and totaled. Total 
errors are converted to a percentile score. 

e. Scoring Aids - Some use is made of scoring aids. 

f. Quality Norms - No separate quality norms are used. Time and 
error scores are combined to obtain a total performance score. 

0. Emphasis in Scorirfg - Emphasis is divided equally beti^^en quality 
and quantity. 

Dbaervation of Clients 

a. Work Performance - No work factors are specified in detail for 
individual work samples. 

b- Work Behaviors - The same 17 defined worker charact'eriatica are 
uaed for all the work aamples. Many of these seem to require 
subjective judgment on the part of the evaluator. Evaluators 
. are encouraged to use only those characteriatics which apply. 

c. Rating Syatem - The evaluator uaea a 5-point scale to rate 
clients on each of the 17 worker characteriatics. 

d. Frequency of Observation - Frequency of observation is not spec- 
ified; ■ however, frequent evaluator contact is required on many 
work samples due to the administration and scoring procedure. 
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7. Reporting 

a» Forms - Standard forms used for scoring and rating of worker 
characteristics. Body position charts are included uiith the 
Upper Body Range of Motion and lilhole Body Range of. Motion work 
samples for recording pain and fatigue areas. 

b* Final Report Format - Because this is not an evaluation system, 
but a group of independent uork sampl ^s no final report form is 
used. 

8. Utility * , 

a. Vocational Exploration - There is limited opportunity for voca- 
tional exploration due to the abstract nature of the uork samples. 

b. Vocational Recommendations > Because these are individual compo- 
nents and not a system evaluation, vocational recommendations 
cannot be made on the basis of one uork sample. The manual 
indicates areas for further vocational exploration. 

c. Counselor Utilization - Because the system uses the purchasing 
facility's report format, counselor utilization cannot be 
specified. 

9. Training in the System 

a. Training Required-- No 

b. Training Available - Yes 

c. Duration - Consultation and training up to 1Q days depending on 
the needs of the evaluator.^ 

10. Technical Considerations _ 

a. Norm Base - Norma are available on: (1) clier^s, (2) sheltered 
uorkshop employees, and (3) employed; uorkers.^ Some sample 
characteristics are not clearly described. 

b. Reliability - Test-retest reliability coefficients uere obtained 
for most uiork samples; most reliability estimates are fairly 
high. V 

c. V/alidi'ty - Mo data available. 

11. RevieuterB Jummarv and Comments - The Valpar Component Work Sample 
Series currently consists of 12 individual work samples which are 
physically uell designed and constructed. They are appealing to 
clients and lend themselves to easy actoinistration and scoring. 
Individual uiork samples can be easily /Incorporated into an existing 

' evaluation program. KoueUer, becauserniesa individual uork samples 
can be purchased as needed by facilities, there are no unified final 
report forms, and other aspects of an integrated system are lacking. 
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12. Address 

Ualpar CorpDratlon 
655 N. Alvernon 
Suite 10B 

Tucson, Arizona 85716 

13. Cost - $5,060 for the current 12 work samples. Individual samples 
range from $260 to $600 • « 

1**, Reference ; 

Brandon, T, L., Button, Ul. L,, Rastatter, C, J., & Ross, D, R,, 

Valpar Component Work Sample System. In A. Sax (Ed.), Innovations 
in vocational evaluation and uork adjustment. Vocational Eval- 
uation and tiiork Ad.1ustment Sull'etln^ 1975. 8 (2), 59-63. 
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WIDE RAWSE EMPLOYMENT- SAMPLE TEST 



(WREST) 



Development 

a. Sponsot - Guidance Associates of Delsuarei Inc* 

b. Target Group - Not specified; however, the original work 
samples were developed in a sheltered workshop dealing with 
the mentally retarded and physically handicapped. 

c. Basis of System - Not specified 
Drqanization 

a. Name and Number of Lilork Samples - The ten work samples are as 
follows: 

(1) Single, Double Folding, Pasting and Stuffing; (2) Stapling; 
(3) Bottle Packaging; M Rice Measuring; (5) Screw Assembly; 
(6) Tag Stringing; (7) Scratch Pasting; (6) Collating; (9) Color 
and Shade Matching; and (10) Pattern Making, \^ 

b. Grouping of Work Samples - Each work sample is independent. 

c. Packaging of Uork Samples The work samples are not individ- 
ually packaged. 

d. Manual A spiral-bound printed manual with photographs contains 
- all system details. 

lilork Evaluation Process 

a. Preliminary Screening - Not specified 

b. Sequence of LJork Sample Administration - Uiork samples are' ad- 
ministered in order starting with number one and ending with 
number ten. ^ 

c. Client Involvement - The manual does not contain information- on 
client involvement. Because the liiREST resembles a formal testing 
situation, it is assumed that there is little client involvement. 

d. Evaluation Setting - Not specified ' 

e. Time to Complete the Entire System - Administration time for 
individual clients /is about one ard a half hours; small groups 
of three to six persons take about two hours. 

Atfininlstration 

a* Procedures - For each work sample, the manual describes the pur- 
pose, and gives the materials, scoring information and instruc- 
.tions. A photograph is used to ensure proper layout. .The lilREST 
can be administered to small groups of three to six persons. 
Duplicate sets of. the tiJREST are necessary for group adminis- 
tration. 




b. 44ethod of Instruction Giving - All instructions ate oral and 

demonstration; no reading is required. 

c. Repeating Uork Samples - Rg^inistration of work samples is 
emphasized for upgrading. • Between six and ten retests are 
recommended for training. Manual does not specify what 
training is to be used for when completed. • 

d. . Providing Assistance to Client - The evaluator is encouraged . 

to ensure the client knows hbw to perform the task before he 
begins to work; procedures for assisting the client after he 
has started the task are not specified. 

Scoring and Norms • 

a. Timing - The evaluator times the client with a stopwatch. 

b. Timing Interval - Timing is begun after the client underatanda 
the task and uaually stops when the work ^sample is completed. 
However, when the client reaches the time period correspontllng 
to a scaled score of zero for 9 particular work sample, the 
task may be discontinued. 

c. Time Norms - The number of minutes and seconds to complete the 
'work sample are recorded; these are compared to. scale scores 



d. Error Scoring - All completed parts are Ojjecked against the 
clearly defined scoring criteria given in the manual. 

B. Scoring Aids - No use is made 0^ scori ig aids. 

f. Quality Norms - The errors for all ter work samples' are addei 
together and the total compared to a norms table. 

g. Emphasis in Scoring - The time results are emphasize'd. 

Dbservation of Clients 

a. Work Performance - Neither specific work performance factors 
nor tljeir observation are mentioned in the manuql. 

b. Work Behaviors - No specific work behaviors are defined anil 
information is given for their observation, 

c. Rating System - No method of rating behaviors -is used. 

d. Frequency of Observation - Not specified 

Reporting 



a. Forms - A "Summary of Results Form" is used to record perform- 
ance and general remferka. . . ' 

b. Final Report Format - Not specified; manual makes no reference 
to a final report. ' 



• ranging from 0 through- 19. 




8. Utility 

a« Vacational Exploration - The very sample nature of most of the 
uork samples makes the UREST of littde use in job exploration, 

b. Vocational Recommendations - Not specified 

c* Counselor Utilization - Not specified 

9. Training in the System 

a# Training Required - No 

b. Training Available - No 

c. Duration - Not applicable 
d# Follotij-up - No 

Technica l Considerations 

a. Norm Base - Male and female norms are available for a numb'^ of 
different age groups. The manual does not give the source of 
these groups and it is not knoun if they are clients, uorkers, 

^ or from the general population. Norms are also available on a 
small sample of employed uorkers. 

b. Reliability > Some reliability estimatea are presented. Test- 
< retest reliabilities are very high. /Also given are estimates 

internaL consistency; ,the methodology used to obtain these 
estimates is v6ry much open to question, 

.c. Validity - No data available 

11, Revieuer's Summary and Comments - The WREST consists of ten, short, 
lotii-level tasks apparently designed to assess mainly the manipulation 
and dexterity abilities of the client. Although It la not stated in 
the manual, the WR^ST seema most usei^l in aaseaaing neu clients for 
assignment to suitable uorM projecta uithin a sheltered uiorkshop. 
The emphasis upon repeating the work samples many times should prOf» . 
vide an evaluation of the client's ability to improve hia performance 
under repeated pr&ctice conditions. The major problema of the 
ayatem center around the lack of systematic behavior observationa, 
failure to relate results to the competitive job market, and the 

: apparent lack of a useable final report for the referring counselor 
or agency. 

12. AddresB 

Guidance Associates of Oelaware, Inc. 
1526 611(iin A ^nue / 
.Ullmlngton, 0& auare 19606 

Coat - $595,00 for uork samples and 25 record forms; manual is 
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